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Abstract 

We introduce a new approach for establishing fixed-parameter tractabil- 
ity of problems parameterized above tight lower bounds or below tight 
upper bounds. To illustrate the approach we consider three problems of 
this type of unknown complexity that were introduced by Mahajan, Ra- 
man and Sikdar (J. Comput. Syst. Sci. 75, 2009). We show that a 
generalization of one of the problems and non-trivial special cases of the 
other two are fixed-parameter tractable. 

1 Introduction 

A parameterized problem 11 can be considered as a set of pairs (/, k) -where / 
is the main part and k (usually an integer) is the parameter. U is called fixed- 
param,eter tractable (FPT) if membership of (J, k) in 11 can be decided in time 
0{f{k)\I\'^), -where \I\ denotes the size of /, f{k) is a computable function, and 
c is a constant independent of k and / (for further background and terminology 
on parameterized complexity we refer the reader to the monographs [51 [51 [T7]). 
If the nonparameterized version of 11 (-where k is just a part of the input) is 
NP-hard, then the function f{k) must be superpolynomial provided P ^ NP. 
Often f{k) is "moderately exponential," -which makes the problem practically 
feasible for small values of k. Thus, it is important to parameterize a problem 
in such a -way that the instances -with small values of k are of real interest. 

Consider the foUo-wing -well-kno-wn problem: given a digraph D = {V,A), 
find an acyclic subdigraph of D -with the maximum number of arcs. We can 
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parameterize this problem "naturally" by asking whether D contains an acyclic 
subdigraph with at least k arcs. It is easy to prove that this parameterized 
problem is fixed-parameter tractable by observing that D always has an acyclic 
subdigraph with at least \A\/2 arcs. (Indeed, consider a bijection a : V ^ 
{!,..., \V\} and the following subdigraphs of D: {V,{xy € A : a{x) < a{y) }) 
and {V,{xy ^ A : a{x) > a{y) }). Both subdigraphs are acyclic and at least one 
of them has at least \A\/2 arcs.) However, k < \A\/2 for every small value of k 
and almost every practical value of \ A\ and, thus, our "natural" parameterization 
is of almost no practical or theoretical interest. 

Instead, one should consider the following parameterized problem: decide 
whether D — {V,A) contains an acycHc subdigraph with at least \A\/2 + k 
arcs. We choose \A\/2 + k because \A\/2 is a tight lower bound on the size of 
a largest acyclic subdigraph. Indeed, the size of a largest acyclic subdigraph of 
a symmetric digraph D — {V,A) is precisely \A\/2. (A digraph D — {V,A) is 
symmetric if xy € A implies yx £ A.) 

In a recent paper [16j Mahajan, Raman and Sikdar provided several examples 
of problems of this type and argued that a natural parameterization is one 
above a tight lower bound for maximization problems, and below a tight upper 
bound for minimization problems. Furthermore, they observed that only a few 
non-trivial results are known for problems parameterized above a tight lower 
bound [TTJ [T21 [T31 [TS] , and they listed several problems parameterized above 
a tight lower bound whose complexity is unknown. The difficulty in showing 
whether such a problem is fixed-parameter tractable can be illustrated by the 
fact that often we even do not know whether the problem is in XP, i.e., can 
be solved in time 0(|/|^^'^^) for a computable function g{k). For example, it 
is non-trivial to see that the above-mentioned digraph problem is in XP when 
parameterized above the \A\/2 bound. 

In this paper we introduce the Strictly Above/Below Expectation Method 
(SABEM), a novel approach for establishing the fixed-parameter tractability of 
maximization problems parameterized above tight lower bounds and minimiza- 
tion problems parameterized below tight upper bounds. The new method is 
based on probabilistic arguments and utilizes certain probabilistic inequalities. 
We will state the equalities in the next section, and in the subsequent sections 
we will apply SABEM to three open problems posed in [16]. 

Now we give a very brief description of the new method with respect to 
a given problem 11 parameterized above a tight lower bound or below a tight 
upper bound. We first apply some reductions rules to reduce 11 to its special 
case n'. Then we introduce a random variable X such that the answer to 11 is 
YES if and only if X takes, with positive probability, a value greater or equal 
to the parameter k. Now using some probabilistic inequalities on X, we derive 
upper bounds on the size of NO-instances of 11' in terms of a function of the 
parameter k. If the size of a given instance exceeds this bound, then we know 
the answer is YES; otherwise, we produce a problem kernel 6 . In many cases, 
we obtain problem kernels of polynomial size. 

In Section [3l we consider the Linear Ordering problem, a generalization 
of the problem discussed above: Given a digraph D = {V, A) in which each arc ij 
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has a positive integral weight Wij , find an acyclic subdigraph of D of maximum 
weight. Observe that W/2, where W is the sum of all arc weights, is a tight lower 
bound for Linear Ordering. We prove that the problem parameterized above 
W/2 is fixed-parameter tractable and admits a quadratic kernel. Note that this 
parameterized problem generalizes the parameterized maximum acyclic subdi- 
graph problem considered in [TB]; thus, our result answers the corresponding 
open question of T6]. 

In Section m we consider the problem Max Lin-2: Given a system of m 
linear equations ei, . . . , e™ in n variables over GF(2), and for each equation Cj 
a positive integral weight Wj ; find an assignment of values to the n variables 
that maximizes the total weight of the satisfied equations. We will see that 
W/2, where W — wi + ■ ■ ■ + w,„, is a tight lower bound for Max Lin-2. The 
complexity of the problem parameterized above W/2 is open [16]. We prove 
that the following three special cases of the parameterized problem are fixed- 
parameter tractable: (1) there is a set U of variables such that each equation 
has an odd number of variables from U, (2) there is a constant r such that each 
equation involves at most r variables, (3) there is a constant p such that any 
variable appears in at most p equations. For all three cases we obtain kernels 
with 0{k^) variables and equations. We also show that if we allow the weights 
Wj to be positive reals, the problem is NP-hard already if fc = 1 and each 
equation involves two variables. 

In Section O we consider the problem Max Exact r-SAT: given an exact 
r-CNF formula C with m clauses (i.e., a CNF formula where each clause contains 
exactly r distinct literals), find a truth assignment that satisfies the maximum 
number of clauses. Here a tight lower bound is (1 — 2~'')to; the complexity of 
the problem parameterized above (1 — 2~^)m is an open question |16j . This 
seems to be the most difficult problem of the three considered. We obtain a 
quadratic kernel for a non-trivial special case of this problem. 

In Section [6l we briefly mention minimization problems parameterized below 
tight upper bounds, provide further discussions of problems considered in this 
paper and point out to a very recent result obtained using our new method. 

2 Probabilistic Inequalities 

In our approach we introduce a random variable X such that the answer to the 
problem parameterized above a tight lower bound or below a tight upper bound 
is YES if and only if X takes with positive probability a value greater or equal 
to the parameter k. 

In this paper all random variables are real. A random variable is discrete if 
its distribution function has a flnite or countable number of positive increases. 
A random variable A" is a symmetric if —X has the same distribution function 
as A. If A is discrete, then A is symmetric if and only if Prob{A = a) = 
Prob(A = —a) for each real a. Let A be a symmetric variable for which the 
first moment E(A) exists. ThenE(A) = E(-A) = -E(A) and, thus, E(A) = 0. 
The following is easy to prove jl8| . 
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Lemma 1. If X is a symmetric random variable and E(X^) < oo, then 



Prob( X > VE(X2) ) > 0. 

See Sections [3] and m for applications of Lemma [TJ Unfortunately, often X is 
not symmetric, but Lemma [2] provides an inequality that can be used in many 
such cases. This lemma was proved by Alon et al. [1]; a weaker version was 
obtained by Hastad and Venkatesh 13J. 

Lemma 2. Let X be a random variable and suppose that its first, second and 
forth moments satisfy E(X) 0, E{X'^) ^ a'^ > and E{X^) < ba^, respec- 
tively. Then Prob( X > > j^^. 

Since it is often rather nontrivial to evaluate E{X^) in order to check whether 
E(X'*) < ba"^ holds, one can sometimes use the following extension of Khinchin's 
Inequality by Bourgain [4J. 

Lemma 3. Let f = f{xi, . . . ,Xn) be a polynomial of degree r in n variables 
Xi, . . . , x„ with domain { — 1, 1}. Define a random variable X by choosing a vec- 
tor (ei, . . . , e„) G { — 1, 1}" uniformly at random and setting X — /(ei, . . . , e„). 
Then, for every p>2, there is a constant Cp such that 

iEi\xn)^/p < icpnE{x^)f/\ 

In particular, C4 < 2'^/2 . 

3 Linear Ordering 

Let D = (V, A) be a digraph with no loops or parallel arcs in which every arc 
ij has a positive weight vuij. The problem of finding an acyclic subdigraph 
of D of maximum weight, known as Linear Ordering, has applications in 
economics [5]. Let n = |y| and consider a bijection a : V {l,...,n}. Observe 
that the subdigraphs {V,{ij G A : a{i) < }) and {V,{ij G A : a{i) > 
a{j) }) are acyclic. Since the two subdigraphs contain all arcs of D, at least 
one of them has weight at least W/2, where W — J2ij£A "^ih ^^"^ weight of D. 
Thus, W/2 is a lower bound on the maximum weight of an acyclic subdigraph 
of D. Consider a digraph D where for every arc ij of D there is also an arc ji 
of the same weight. Each maximum weight subdigraph of D has weight exactly 
W/2. Hence the lower bound W/2 is tight. 

Linear Ordering Above Tight Lower Bound (LOALB) 

Instance: A digraph D = (V, A), each arc ij has an integral positive 
weight Wij, and a positive integer k. 

Parameter: The integer k. 

Question: Is there an acyclic subdigraph of D of weight at least 
W/2 + fc, where W = J2^JeA "^v ? 
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Mahajan, Raman, and Sikdar [12] asked whether LOALB is fixed-parameter 
tractable for the special case when all arcs are of weight 1 (i.e., D is unweighted). 
In this section we will prove that LOALB admits a kernel with O(fc^) arcs; 
consequently the problem is fixed-parameter tractable. Note that if we allow 
weights to be positive reals, then we can show, similarly to the NP-completeness 
proof given in the next section, that LOALB is NP-complete already for k = 1. 
Consider the following reduction rule: 

Reduction Rule 1. Assume D has a directed 2-cycle iji; if Wij — Wji delete 
the cycle, if Wij > Wji delete the arc ji and replace Wij by wij — wji, and if 
Wji > Wij delete the arc ij and replace Wji by Wji — Wij . 

It is easy to check that the answer to LOALB for a digraph D is yes if and 
only if the answer to LOALB is yes for a digraph obtained from D using the 
reduction rule as long as possible. 

Let D = {V,A) be an oriented graph, let n — \V\ and W — J2ij<£A''^ij- 
Consider a random bijection: a : V ~> and a random variable X{a) = 

1 Hijf^A ^iji^)^ where (a) = Wij if a{i) < a{j) and e.y (a) = -Wy, otherwise. 
It is easy to see that X{a) = ^{wij : ij e A,a{i) < a{j) } — W/2. Thus, the 
answer to LOALB is yes if and only if there is a bijection a : V {1, . . . ,n} 
such that X{a) > k. Since E(eij) = 0, we have ¥.{X) = 0. 

Let W^(^) =E,jeA<- We will prove the following: 

Lemma 4. E(A2) > W^'^^U. 

Proof. Let N~^{i) and N~{i) denote the sets of out-neighbors and in- neighbors 
of a vertex i in D. By the definition of X, 

A-E{X')=Y,n^l)+ E IE(e.,^p,), (1) 

where the second sum is taken over ordered pairs of distinct arcs. Clearly, 
E„-6aE(4) = W^'\ To compute E.,; ,pq£A^i^-i3^pg) consider the following 
cases: 

Case 1: {i,j} H {p, q} — 0. Then Cij and epq are independent and ]K{eijepq) = 
E(ey)E(ep,) = 0. 

Case 2a: H {p, g}| ~ 1 and i ~ p. Since the probability that i < 

min{j, q} or i > max{j, q} is 2/3, eijSiq — WijWiq with probability | and 6^6^^ = 
—WijWiq with probability |. Thus, for every i G V we have J^ij iq^A ^i^ij^iq) = 
3 E{ ^^3W^q : j y^ q G N+ii) } = liJ2jeN+(i) )^ - 5 EjeAr+ w w^r 

Case 2b: H {p, <7}| — 1 and j — q. Similarly to Case 2a, we obtain 
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Case 3a: \{i,j}n{p,q}\ = la.ndi^q. Since ^ij^pi — WijWpi with probability 
I and SijSpi = -WijWpi with probabihty |, we obtain I^zj.pieA ^(^u^pO = 
-\Y.{wioWp, : j e N+{i), peN-{i)} = -lJ2jeN+it)Wi3T,peN-{z)Wpi- 

Case 3b: H {p, g}| = 1 and j = p. Similarly to Case 3a, we obtain 

Equation ^ and the subsequent computations imply that 4-E(X^) = 14^*^^^ + 
^{Q — R), where 

iGV \ jgAr+(i) j^N+{i) jGN-{i) j&N-{i) J 

and 

R-^-Yi Y ^'^)( Y ^^O- 

By the inequality of arithmetic and geometric means, for each i e T^, we have 

( Y ^vY + i Y J2 Y WjO^O- 

jeJV+W jeN-{i) j£N+ii) j&N-ii) 

Therefore, 

Q-R>-Y Y <-Y Y ^l--'^w^'\ 

iev jeN+(i) ieVjeN-(i) 

and 4 • E(X2) > W^^'> - 2W^^^ /3 = VF^^) /3, implying E{X^) > W^^'> /12. □ 

Now we can prove the main result of this section. 

Theorem 1. The problem LOALB admits a kernel with 0{k^) arcs. 

Proof. Let iJ be a digraph. We know that the answer to LOALB for H is yes if 
and only if the answer to LOALB is yes for a digraph D obtained from H using 
Reduction Rule [T] as long as possible. Observe that D is an oriented graph. 
Let B be the set of bijections from V to {1, . . . ,n}. Observe that / : B ^ B 
such that f{a{v)) — |V^| + 1 — a{v) for each a S ;B is a bijection. Note that 
X{f{a)) = -X{a) for each a e B. Therefore, Prob(A: = a) = Prob(X = -a) 
for each real a and, thus, X is symmetric. Thus, by Lemmas [1] and |31 we have 
Prob( X > yW^^yjU ) > 0. Hence, if yW^^TJn > k, there is a bijection 
a : V {1, . . . ,n} such that X{a) > k and, thus, the answer to LOALB (for 
both D and H) is yes. Otherwise, \A\ < W^^^ < 12 • fc^. □ 

We close this section by outlining how Theorem [1] can be used to actually find a 
solution to LOALB if one exists. Let {D, k) be an instance of LOALB where 
D — {V, A) is, a. directed graph with integral positive arc- weights and A; > 1 is an 
integer. Let W be the total weight of D. As discussed above, we may assume 
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that D is an oriented graph. If \A\ < 12k'^ then we can find a solution, if one 
exists, by trying all subsets A' C A, and testing whether {V,A') is acyclic and 
has weight at least W/2 + k; this search can be carried out in time 2'-"-'' \ Next 
we assume \A\ > 12k^. We know by Theorem [T] that {D,k) is a YES-instance; 
it remains to find a solution. 

For a vertex i g ^ let doii) denote its unweighted degree in D, i.e., the 
number of arcs (incoming or outgoing) that are incident with i. Consider the 
following reduction rule: 

Reduction Rule 2. // there is a vertex i E V with \A\ — 12k^ > do{i), then 
delete i from D. 

Observe that by applying the rule we obtain again a YES-instance {D — i,k) 
of LOALB since D ~ i has still at least 12k^ arcs. Moreover, if we know a 
solution D[ of {D — i,k), then we can efficiently obtain a solution D' of {D,k): 

if J2jGN+{t)^v - Hj£N-(i)'^i3 ^^'^^ ^'^ ^"^d * ^'^'^ outgoing arcs ij £ A 
to D[\ otherwise, we add i and all incoming arcs ji e A to D[. After multiple 
applications of Rule we are left with an instance {Do,k) to which Ruled] 
cannot be applied. Let Dq = {Vo,Ao). We pick a vertex i G Vq. If i has a 
neighbor j with dooiJ) = 1, then \Ao\ < 12k^, since \Ao\ - rf_Do(j) < 12P. On 
the other hand, if duo (j) > 2 for all neighbors j of i, then i has less than 2 • 12k^ 
neighbors, since Do — i has less than 12k^ arcs; thus \Ao\ < 3 • 12k^. Therefore, 
as above, time 2'^'-'^ ^ is sufficient to try all subsets A'q C Aq to find a solution to 
the instance {Dq, k). Let n denote the input size of instance {D, k). Rule [2] can 
certainly be applied in polynomial time n'^^^\ and we apply it less than n times. 
Hence, we can find a solution to {D, k), if one exists, in time n'-'^^'> + 2"^^*^ \ 

Recall that a kernelization reduces in polynomial time an instance (/, k) of 
a parameterized problem to a decision- equivalent instance {I',k'), its problem 
kernel, where k' < k and the size of /' is bounded by a function of k. Solutions 
for (J, k) and solutions for (/', k') are possibly unrelated to each other. We call 
(/', k') a faithful problem kernel if from a solution for (/', k') we can construct 
a solution for (/, k) in time polynomial in |/| and k. Clearly the above (Dq, k) 
is a faithful kernel. 

4 Max Lin-2 

Consider a system of m linear equations ei, . . . , in n variables zi, . . . , 2;„ over 
GF(2), and suppose that each equation Cj has a positive integral weight Wj, 
j = 1, . . . ,TO. The problem Max Lin-2 asks for an assignment of values to 
the variables that maximizes the total weight of the satisfied equations. Let 

W = Wi -\- ■ ■ ■ -\- Wm- 

To see that the total weight of the equations that can be satisfied is at least 
W/2, we describe a simple procedure suggested in [13_. We assign values to the 
variables zi, . . . , 2:„ one by one and simplify the system after each assignment. 
When we wish to assign or 1 to z^, we consider all equations reduced to the 
form Zi — b, for a constant b. Let W' be the total weight of all such equations. 
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We set Zi := 0, if the total weight of such equations is at least W jl, and set 
Zi := 1, otherwise. If there are no equations of the form Zi = b, we set Zj :— 0. 
To see that the lower bound W/2 is tight, consider a system consisting of pairs 
of equations of the form X^ie/ = ^ ^-^d X^ie/ ~ where both equations 
have the same weight. 

The parameterized complexity of Max Lin- 2 parameterized above the tight 
lower bound W/2 was stated by Mahajan, Raman and Sikdar [16] as an open 
question: 

Max Lin-2 Parameterized Above Tight Lower Bound (LinALB) 

Instance: A system S of m linear equations ei, . . . , e„i in n vari- 
ables Zi, . . . , Zn over GF(2), each equation with a positive integral 
weight Wi, i = 1, 2, . . . , to, and a positive integer k. Each equation 
Cj can be written as Xig/^ — ^ji where 7^ Jj- C {1, . . . , n}. 
Parameter: The integer k. 

Question: Is there an assignment of values to the variables zi , . . . , z„ 
such that the total weight of the satisfied equations is at least W/2 + 
k, where W = Xl!li "^i^ 

Let rj be the number of variables in equation Cj, and let r{S) = max^j^r^. 
We are not able to determine whether LinALB is fixed-parameter tractable or 
not, but we can prove that the following three special cases are fixed-parameter 
tractable: (1) there is a set U of variables such that each equation contains an 
odd number of variables from J7, (2) there is a constant r such that r{S) < r, 
(3) there is a constant p such that any variable appears in at most p equations. 

Notice that in our formulation of LinALB it is required that each equation 
has a positive integral weight. In a relaxed setting in which an equation may 
have any positive real number as its weight, the problem is NP-complete even 
for A; = 1 and each rj = 2. Indeed, let each linear equation be of the form 
Zu + Zv = 1. Then the problem is equivalent to MaxCut, the problem of 
finding a cut of total weight at least L in an undirected graph G, where V{G) 
is the set of variables, E(G) contains if and only if there is a linear 

equation Zu + Zv = 1, and the weight of an edge (z„,Zu) equals the weight of 
the corresponding linear equation. The problem MaxCut is a well-known NP- 
complete problem. Let us transform an instance / of MaxCut into an instance 
/' of the "relaxed" LinALB by replacing the weight Wi by w[ := Wi/{L — W/2). 
We may assume that L — W/2 > since otherwise the instance is immediately 
seen as a YES-instance. Observe that the new instance /' has an assignment of 
values with total weight at least W' /2 -I- 1 if and only if / has a cut with total 
weight at least L. We are done. 

Let A be the matrix of the coefhcients of the variables in S. It is well-known 
that the maximum number of linearly independent columns of A equals rankA, 
and such a collection of columns can be found in time polynomial in n and m, 
using, e.g., the Gaussian elimination on columns [3]. We have the following 
reduction rule and supporting lemma. 
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Reduction Rule 3. Let A be the matrix of the coefficients of the variables in 
S, let t ~ rankA and let columns a*^ , . . . , a*' of A be linearly independent. Then 
delete all variables not in {zi-^, . . . , Zi^} from the equations of S. 

Lemma 5. Let T be obtained from S by Rule\^ Then T is a YES-instance if 
and only if S is a YES-instance. Moreover, T can be obtained from S in time 
polynomial in n and ni. 

Proof. If i = n, set T := S, so assume that t < n. The remark before the lemma 
immediately implies that T can be obtained from S in time polynomial in n 
and m. Let S' be a system of equations from S and let T' be the corresponding 
system of equations from T. It is sufficient to prove the following claim: 

There is an assignment of values to zi , . . . , z„ satisfying all equations in S' 
and falsifying the rest of equations in S if and only if there is an assignment 
of values to , . . . , Zi^ satisfying all equations in T' and falsifying the rest of 
equations in T. 

Let an assignment z^ of values to z = (zi, . . . , z„) satisfy all equations of S' 
and falsify the equations of S", where S" — S \ S' . This assignment satisfies all 
equations of i?, the system obtained from S by replacing the right hand side 
bj of each equation in S" by 1 — bj. Note that R has the same matrix A of 
coefficients with columns a^, . . . , a". Let a column a* ^ {a^^ , . . . , a*'}. Then, by 
definition of a*^ , . . . , a*' , a* = Aia*^ + • • • + Ata** for some numbers Xj G {0, 1}. 
Knowing the numbers Xj, we may eliminate a variable Zi from R by replacing 
a* with the sum of all columns from {a*^ , . . . , a** } for which Xj = 1 and carrying 
out the obvious simplification of the system. Thus, we may eliminate from R 
all variables Zi ^ {zji, • ■ • , Zi^} and get yi^a^^ + • • • + t/i^a** = b' , where b' is the 
right hand side of R and each yj E {0, 1}. Now replace, in the modified R, the 
right hand side b'j of each equation corresponding to an equation in S" by 1 — b'j 
obtaining T. Clearly, (y^ ^ , . . . , ) satisfies all equations of T' and falsifies all 
equations in T" = T\T'. 

Suppose now that (y^j^, . . . ,yi^) satisfies all equations of T' and falsifies all 
equations in T". Then (jji, . . . , yn), where yj = if j ^ {ii, . . . , it}, satisfies 
all equations of S' and falsifies all equations in S" . Thus, the claim has been 
proved. □ 

Consider the following reduction rule for LinALB used in [13]. 

Reduction Rule 4. // we have, for a subset I of {1, 2, . . . , n} , the equation 
— with weight w' , and the equation Zi = b" with weight w" , 

then we replace this pair by one of these equations with weight w' + w" ifb' = b" 
and, otherwise, by the equation whose weight is bigger, modifying its new weight 
to be the difference of the two old ones. If the resulting weight is 0, we omit the 
equation from the system. 

If Rule [4] is not applicable to a system we call the system reduced under Rule 
Note that the problem LinALB for S and the system obtained from S by 
applying Rule [3] as long as possible have the same answer. 



9 



Let Ij C {1, . . . ,rt} be the set of indices of the variables participating in 
equation ej, and let bj £ {0, 1} be the right hand side of ej. Define a random 
variable X — X^Jli where Xj = {—l)''^Wj Yli^j. and all the are inde- 
pendent uniform random variables on { — 1,1} {X was first introduced in [TB]). 
We set = if = 1 and Zi = 1, otherwise, for each i. Observe that Xj = Wj 
if Cj is satisfied and Xj = — Wj, otherwise. 

Lemma 6. Let S be reduced under Rule^ The weight of the satisfied equations 
is at least W/2 + k if and only if X > 2k. We have E{X) ^ and E{X'^) = 

Em 9 
,=1^1 

Proof. Observe that X is the difference between the weights of satisfied and 
non-satisfied equations. Therefore, the weight of the satisfied equations equals 
{X + W)/2, and it is at least W/2 -I- fc if and only if X > 2k. Since are 
independent, = Oze/, H<^^) = 0- Thus, E{Xj) = and E{X) = 

by linearity of expectation. Moreover, 

m m 

j=i i<i#g<m j=i 

as HU^eI, e^•^^G7, = ^iIl^eI,AI, ^0 = implies E{X,Xg) = 0, where /, A/, 
is the symmetric difference between Ij and Iq {IjAIg ^ due to Reduction Rule 
SD. □ 

Lemma 7. Let S be reduced under Rule^ and suppose that no variable appears 
in more than p>2 equations of S . Then E(X^) < 2p^{E{X'^)f. 

Proof. Observe that 

E{X^)= E nXpXqXsXt), (2) 

(p,g,s,t)e[m]'i 

where [m] = {1, . . . , m}. Note that if the product XpXqXgXt contains a variable 
ei in only one or three of the factors, then E{XpXqXsXt) = A ■ E(ei) = 0, where 
^ is a polynomial in random variables e;, I e {1, . . . ,n} \ {i}. Thus, the only 
nonzero terms in ^ are those for which either [1) p — q — s — t, ov (2) there 
are two distinct integers j, I such that each of them coincides with two elements 
in the sequence p,q,s,t, or (3) |{p, s,t}| = 4, but each variable appears 
in an even number of the factors in XpXqX^Xt. In Cases 1 and 2, we have 
E{XpXqXsXt) — Wp and E{XpXqXsXt) = Wjwf, respectively. In Case 3, 

E{XpXqXsXt) < WpWqWsWt < {wf^Wq +wlw'j)/2. 

Let 1 < j < I < m. Observe that E{XpXqXsXt) = Wjwf in Case 2 for 
(2) = 6 4-tuples (p, q, s, t) £ [m]^. In Case 3, we claim that j, I e {p, q, s, t} for 
at most 4 • (p — 1)^ 4-tuples {p, q, s, t) e [m]"'. To see this, first note that w^id^ 
and w'^Wf appear in our upper bound on E{XpXqXsXt) (with coefficient 1/2). 
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Therefore, there are only four possible ways for w'^wf to appear in our upper 
bound, namely the following: (i) j = p,l = q, (ii) I = p, j — q, (iii) j ^ s,l = t, 
and (iv) I — s,j — t. Now assume, without loss of generality, that j — p and 
/ = q. Since S is reduced under RulelH the product XjXi must have a variable 
of degree one. Thus, must be in or Xt, but not in both (two choices). 
Assume that is in Xs- Observe that there are at most p — 1 choices for s. 
Note that XjXiXg must contain contain a variable Cj' of odd degree. Thus, e^' 
must be in Xt and, hence, there are at most p — 1 choices for t. 
Therefore, we have 

m / m 

j = l l<j<l<m y=i 

Thus, by LemmaH ]K{X*) < 2p^{E{X^))^. □ 

Case 1 of Theorem [5] is of interest since its condition can be checked in 
polynomial time due to the following: 

Proposition 1. We can check, in polynomial time, whether there exists a set 
U of variables such that each equation of S contains an odd number of variables 
from U. 

Proof. Observe that such a set U exists if and only if the unweighted system 
S" of linear equations over GF(2) obtained from S by replacing each bj with 
1 has a solution. Indeed, if U exists, set Zj — 1 for each zj G U and Zj = 
for each Zj ^ U . This assignment is a solution to S' . If a solution to S' exists, 
form U by including in it all variables Zj which equal 1 in the solution. We 
can check whether S' has a solution using the Gaussian elimination or other 
polynomial-time algorithms, see, e.g., [5]. □ 

Now we can prove the following: 

Theorem 2. Let S be reduced under Rule^ The following three special cases 
of LinALB are fixed-parameter tractable: (1) there is a set U of variables such 
that each equation contains an odd number of variables from U , (2) there is a 
constant r such that r{S) < r, (3) there is a constant p, such that any variable 
appears in at most p equations. In each case, there exists a kernel with 0{k^) 
equations and variables. 

Proof. Case 1. Let z^ — (zj*, . . . , zJJ) S {0,1}" be an assignment of values 
to the variables zi, . . . , z„, and let —z'^ = (zj^, . . . , z^), where z[ = 1 — z° if 
Zi £ U and z[ — z^, otherwise, i — l,...,n. Observe that / : z° i-^ — z" 
is a bijection on the set of assignments and X{—z^) = — A"(z"). Thus, A" is a 
symmetric random variable. Therefore, by Lemmas [l]and[6l Prob( X > ^/m ) > 

Prob( X > ^J2T=i ) > 0. Hence, if > 2k, the answer to LinALB is 
YES. Otherwise, m < Ak^ and after applying Rule[3l we obtain a kernel with 
0{k'^) equations and variables. 
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Case 2. Since X is a polynomial of degree at most r, it follows by Lemma 
[3] that E{X^) < 26''E(X2)2. This inequality and the results in the previous 
paragraph show that the conditions of Lemma [5] are satisfied and, thus, 



Consequently, if 2fc — 1 < y/m/(4: ■ 8^), then there is an assignment of values to 
the variables zi, . . . , 2;„ which satisfies equations of total weight at least W/2 + k. 
Otherwise, 2k - 1 > v^/(4 • 8'') and m < 16(2fc - 1)264''. After applying Rule 
[3l we obtain the required kernel. 

Case 3. If p = 1, it is easy to find an assignment to the variables that satisfies 
all equations of S. Thus, we may assume that p > 2. To prove that there exists 
a kernel with 0{k^) equations, we can proceed as in Case 2, but use Lemma[7] 
rather than Lemma [H □ 

Remark 1. Note that even if S does not satisfy Case 2 of the theorem, T, 
the system obtained from S using Rule [31 may still satisfy Case 2. However, 
we have not formulated the theorem for S reduced under Rule [3] as the reduced 
system depends on the choice of a maximum linear independent collection of 
columns of A. 

Remark 2. Unfortunately, we cannot use Lemma [2] for X to prove that the 
whole problem LinALB is fixed-parameter tractable. This is due to the fact 
that E(A^) > Q{E{X'^)^) for some systems S. One such system is X^ie/ = ^ 
for each nonempty subset / of {1, . . . , n}. (Thus, m — 2" — 1.) We set the weight 
Wj = 1 for every j — 1, . . . , m. By Lemma [51 E{X'^) = m. Let Qn be the set 
of 4-tuples (p, q, s, t) e [m]'*, where [m] = {1, . . . , m}, such that g, s, t}| =4 
and each variable appears in an even number of the factors in XpXqXgXf. 
By the proof of Lemma [3 we have E{X'^) > J2{p.q.s,t)£Q ^p-^q-^sXt = \Qn\- 
Let {p,q,s,t) G Qn-i (we allow only variables ei, . . . in Xp, Xg, Xg and 

Xt). We can construct eight 4-tuples in using {p, q, s, t) as a starting point. 
Indeed, we can multiply each of Xp, Xq, Xs and Xt by e„, or exactly two of 
Xp, Xq, Xs and Xt by e„, or keep Xp, Xq, X^ and Xt without a change. Thus, 



\Qn\ > 8|g„-i|. Therefore, E{X*) > \Qn-3\ > 8""^ > = E{X^)y8^ as 



A faithful kernel can be found for all three cases of Theorem[2l but we restrict 
ourselves to Case 2. Consider an instance {S, k) of LinALB over n variables 



with r = r{S) = 0(1), \S\ = m > f{k,r), where f{k,r) = 16(2fc - 1)264'' 



and assume S is reduced under Reduction Rule HI We can find a solution for 
(S, k) (i.e., an assignment satisfying at least 14^/2 -I- k equations) in polynomial 
time by using the observation from 1 that the random variables are 4r-wise 
independent and, thus, one can use an 0(n2'')-size sample space to support each 
Ci (for more details and the sample space construction, see [I]). 



Prob 




> 0, implying Prob X > 




> 0. 



IQsl > 1. 
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Alternatively, we can use a modification of the approach given earlier for 
LOALB to obtain in polynomial time a faithful kernel. Similar approaches can 
be used to obtain faithful kernels for Cases 1 and 3. Consider the following 
reduction rule: 

Reduction Rule 5. // there is some variable x of S that occurs in at most 
\S\ — f{k, r) equations, then remove all the equations from S in which x occurs. 

Let T be the system obtained from S using Rule [31 Apply Rule [5] to T as 
long as possible. Note that we can transform a solution for (T, k) to a solution 
for [S, k) by assigning zero to all variables not in T . To show that the number of 
equations in T is polynomially bounded in fc, let x be a variable of T that occurs 
in the smallest number of equations of T, and let T = T1UT2 where all equations 
in Ti contain x and no equation in T2 contains x. Since T is reduced under Rule 
m 1721 < f{k, r) ^ 0{k^); thus T2 involves at most r ■ f{k, r) = 0{k'^) variables. 
However, by Rule [3] and the choice of x, x is the only variable that occurs in 
Ti but does not occur in T2. Hence |Ti| = 0((r • /(fc,r))'-i) = Oik^"-^) and 

|r| =0(fc2+fc2'-2). 

5 Max Exact r-SAT 

Let X — {xi,X2, ■ ■ ■ ,Xn) be a vector of Boolean variables. We assume that 
each variable Xi attains 1 or —1 (meaning true and false, respectively). We 
will denote the negation of a variable Xi by —Xi and we let L = {xi,X2, ■ ■ ■ , 
Xn, —Xi, —X2, ■ ■ ■ be the set of literals over xi, . . . , a;„. Let r > 2 be a 

fixed integer, and let C = {Ci, C2, . . . , Cm} be a set of clauses, each involving 
exactly r distinct literals from L such that for no pair y, z of literals we have 
y = —z. Then C is an exact r-CNF formula. 

Consider an exact r-CNF formula C with m clauses and a random truth 
assignment for x. Since the probability of a clause of C to be satisfied is 1 — 2^^, 
the expected number of satisfied clauses in C is (1 — 2^'')m. Thus, there is a 
truth assignment for x that satisfies at least (1 — 2^''~)m clauses. This bound 
is tight as can be seen by considering an r-CNF formula that contains all 2^ 
possible clauses over the same r variables, or by considering a disjoint union of 
several such r-CNF formulas. 

Mahajan, Raman and Sikdar [TOj stated the complexity of the following 
problem as an open question. 

Exact r-SAT Above Tight Lower Bound (r-SATALB) 

Instance: An exact r-CNF formula C and a positive rational num- 
ber k with denominator 2^ . 

Parameter: The number k. 

Question: Is there a truth assignment {x'l, 2:2, . . . , a;^) satisfying at 
least (1 — 2^^)m + k clauses of C? 
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Mahajan, Raman and Sikdar [TB] require fc to be a positive integer, but since 
(1 — 2~^)m is a positive rational number with denominator 2'", our setting for 
k seems more natural. 

We will prove that the problem has a quadratic kernel for a wide family 
of instances. We say that a pair of distinct clauses Y and Z has a conflict if 
there is a literal p € Y such that —p G Z. We say that a pair Y and Z has 
an overlap if Y and Z have common literals, but they do not have a conflict. 
For an exact r-CNF formula C, the conflict number cn(C) = c — o, where c 
(o, respectively) is the number of ordered pairs of clauses having a conflict (an 
overlap, respectively). 

Theorem 3. The problem r-SATALB restricted to exact r-CNF formulas with 
m clauses and of conflict number at most (2'' — 2)m admits a quadratic kernel. 

To establish the theorem, consider an exact r-CNF formula C with m clauses 
and of conflict number at most (2'' — 2)m, and consider a clause Z of C. 
Let , 2:^2 , ... , Xi^ be the variables corresponding to the literals of Z and let 
x° , , . . . , a;°^ be the unique truth assignment not satisfying Z. Define a ran- 
dom variable Xz as follows: Let V = {—1, lY — {{x^^ ,x^^, . . . ,x^^)} and 



The value of Xz at a truth assignment x' = {x[,X2, ■ ■ ■ , x'^) is 2^^ if x' satisfies 
Z (in this case the product equals 2''), and it is — 1, otherwise. Let X = 
^zec -^z {X is a special case of a random variable introduced in [T]). 

We study some properties of X in the following two lemmas. 

Lemma 8. Let x' — (x'i,x'2, ■ ■ ■ ,a;Jj) be a truth assignment. Then the value of 
X at x' equals m{x') — (1 — 2~'')m, where m{x') is the number of clauses in C 
satisfied by x' . Thus, the answer to r-SATALB is yes if and only if X{x") > k 
for some truth assignment x" . We also haveE{X) = andE{X^) < 2^''E{X'^)'^ . 

Proof. Let x' = {x[,x'2, . . ■ ,x'^) be a truth assignment. Observe that X{x') = 
mix')2-'- + (2-'- - l)(m - mix')) = m(x') - (1 - 2-'^)m. Hence, m{x') > 
(1 - 2-"^)™ -I- fc if and only if Xix') > fc. 

Observe that the probability of Z being satisfied (not satisfied) is 1 — 2~^ 
{2~^). Thus, the expectation of Xz is zero, and E(A) = by linearity of 
expectation. Since A is a polynomial of degree at most r in xi^X2, ■ . ■ ,Xn, it 
follows, by LemmaS that E(A4) < 2^'-E{X'^)^. □ 

Lemma 9. We have E{X'^) > to4-''. 

Proof Observe that E{X^) = J2zec^(^z) + J^Y^zec^i^YXz). We wiU 
compute E(A|) and E{XyXz) separately. 

By the proof of Lemma [3 Xz equals 2^*" with probability 1 — 2^'' and 
2-' - 1 with probability 2"^ Thus, A| equals 2-^"^ with probability 1 - 2-'' 
and (2-'' - 1)2 with probability 2"''. Hence, E(A|) = 2-'' - 4-''. 




+ 




(vi,...,vr)ev 
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For a clause Y oi C, let vars(y) denote the sets of variables in Y and let 
lits(F) be the set of literals in Y. To evaluate E{XyXz), we consider the 
following three cases: 

Case 1: vars(y) n vars(Z) = 0. Then Xy and Xz are independent random 
variables and, thus, Ei^XyXz) = E(Xy)E(Xz) = 0. 

Case 2: Y and Z have a conflict. Then XyXz equals 2~''(2~'' — 1) with 
probability 2~'^~^^, and XyXz equals 2"^'' with probability 1 — 2"''+^. Hence, 

E{XyXz) = -4-^ 

Case 3: |vars(r)nvars(Z)| = t > and |lits(r)nlits(Z)| = t. Since Y ^ Z,we 
have 1 < t < r. Without loss of generality, assume that lits(y) — {xi, . . . ,Xt, 
Xt+ij ■ ■ ■ Xr} and lits(Z) — {xi, . . . ,Xt, Xr+i, ■ ■ ■ X2r~t}- Thus, XyXz equals 
(2"'' - 1)2 with probability 2*-2'-, 2-''(2-'' - 1) with probability (2'^-*+^ - 
2)/22'-*, and 2-2'- with probability (1 - 2'-*+i + 2^'-*)/2^''-K Hence, 

E{XyXz) = 2*'2r-(i „ 2-*) > 4-'-. 
Since cn(C) < (2^ — 2)m, we have 

> E(X|) + E{XyXz) > (2-'' - 4-'')m - cn(C) • A'"^ > m4-^ 
zee Y^zec 

□ 

Now we can complete the proof of Theorem[3l By LemmasIU |8]and[9l Prob( X > 
V^/(2'^ • 4 • 8*^) ) > 0. Thus, if 7^/(2'' • 4 • 8*^) > fc, there is a truth assignment 
x' such that X{x') > k, i.e., the answer to the instance of r-SATALB is yes. 
Otherwise, m < 16 • 256^ k^. Thus Theorem [3] is established. 

Consider a YES-instance (C, k) of r-SATALB with n variables, m > 16 • 256^k'^ 
clauses, and cn(C) < (2'" — 2)m. As in the previous section, we can find in 
polynomial time a solution for (C, k) using the facts that each random variable 
Xi is 4r-wise independent and there is an 0{n^^)-size sample space to support 
each Xi. 

6 Discussions 

We have showed that the new method allows us to prove that some maximization 
problems parameterized above tight lower bounds are fixed-parameter tractable. 
Our method can also be used for minimization problems parameterized below 
tight upper bounds. As a simple example, consider the feedback arc problem: 
given a digraph D — (V, A) find a minimum set F of arcs such that D — F is 
acyclic. Certainly, \A\/2 is a tight upper bound on a minimum feedback set 
and we can consider the parameterized problem which asks whether D has a 
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feedback arc set with at most |A|/2 — arcs. Fixed-parameter tractability of this 
parameterized problem follows immediately from fixed-parameter tractability 
of LOALB, but we could prove this result directly using essentially the same 
approach as for LOALB. 

It would be interesting to obtain applications of our method to other prob- 
lems parameterized above tight lower bounds or below tight upper bounds. One 
such very recent application is given in [9] , where an open problem due to Benny 
Chor and described in [T7] was solved. The random variable X considered there 
is not symmetric and both application of Lemma [3] and computation of E(X^) 
are more involved than for the problems considered in this paper. 

Let us provide further comments on the problems considered in this paper. 
First, it is natural to parameterize Max Lin-2 not just by k but also by r = 
r{S). The proof of Case 2 of Theorem [2] shows immediately that this two- 
parameter problem is fixed-parameter tractable (but our problem kernel is no 
longer of polynomial size). This result can be viewed as a contribution towards 
Multivariate Algorithmics as outlined by Fellows 7] . Second, we have managed 
to obtain a polynomial problem kernel for 2-SATALB in [T^. The approach 
there is very different from the method we introduced here and it involves signed 
weighted graphs, graph matching theory and the first moment probabilistic 
method. Perhaps, the approach of [TU] can be extended to 3-SATALB, but we 
doubt that it can be extended to r-SATALB for r > 3. 
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